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We consider a one-sided transitive subshift of finite type cr : S — > E 
and a Holder observable A. In the ergodic optimization model, one 
is interested in properties of ^-minimizing probability measures. If 
A denotes the minimizing ergodic value of A, a sub-action u for A 
is by definition a continuous function such that A > u o a — u + A. 
We call contact locus of u with respect to A the subset of S where 
A = uoa — u + A. A calibrated sub-action u gives the possibility to 
construct, for any point a; G S, backward orbits in the contact locus of 
u. In the opposite direction, a separating sub-action gives the smallest 
contact locus of A, that we call i^{A), the set of non- wandering points 
with respect to A. 

We prove that separating sub-actions are generic among Holder 
sub-actions. We also prove that, under certain conditions on fi(/l), 
any calibrated sub-action is of the form u{x) — u{xi) ~\- hA{xi,x) for 
some Xi G ^{A), where hA{x,y) denotes the Peierls barrier of A. We 
present the proofs in the holonomic optimization model, a formalism 
which allows to take into account a two-sided transitive subshift of 
finite type (E, a). 
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1 Introduction 

In the ergodic optimization model (see, for instance, [2} [3l [5| [9l [T5 | [T6l [T8] ). 
given a continuous observable A : X — s- M, one is interested in understanding 
which T-invariant Borel probabihty measure /i of a compact metric space 
X minimizes the average J-^Adfj,. Such measures are called minimizing 
probability measure^ 

Minimizing probability measures admit dual objects: the sub-actions. A 
sub-action n : X — > M associated to an observable A enables to replace A by 
a cohomologous observable whose ergodic minimizing value is actually the 
absolute minimum. To each sub-action u one associates a compact subset 
of X called contact locus which contains the support of any minimizing 
probability measure. A sub-action gives therefore important information on 
T-invariant Borel probability measures that minimize the average of A. It 
is a relevant problem to investigate the existence of a particular sub-action 
having the smallest contact locus, that is, the smallest "trapping region" of 
all minimizing probability measures. 

In section [21 we give a simplified version for the ergodic optimization 
model of the main results, namely, of the theorems [TOl [TT] and [T21 In sec- 
tion [3l we recall the definition of the holonomic optimization model and 
state the main results. We give in section H] the proof of theorem [10] and 
in section [5] the proof of theorem [T2j We address the reader to [13j for a 
proof of theorem [TTl We will adopt throughout the text the point of view 
which consists in interpreting ergodic optimization problems as questions of 
variational dynamics (see, for instance, [HI US [IB] ) j similar to Aubry-Mather 
technics for Lagrangian systems. For an expository introduction to the gen- 
eral theory of ergodic optimization, we refer the reader to the article of O. 
Jenkinson (see [16j). 

We still would like to point out that one of the main conjectures in the 
theory of ergodic optimization on compact spaces can be roughly formulated 
in the following way: in any hyperbolic dynamics, a generic Holder ( or Lip- 
shitz) observable possesses an unique minimizing probability measure, which 
is supported by a periodic orbit. Concerning this problem, partial answers 
were already obtained, among them [3l [9l [151 US ISOl [ZI]- Working with a 
transitive expanding dynamical system, J. Bremont (see [5]) has recently 
shown how such conjecture might follow from a careful study of the contact 
loci of typical sub-actions with finitely many connected components. Of 
course, such result reaffirms the importance of the study of sub-actions as 
well as of their respective contact loci. 

In the same dynamical context, we are in particular interested in finding 

^Maximizing probabilities also appear in the literature. Obviously, replacing the ob- 
servable A by ~A, both vocabularies can be interchanged and the rephrased statements 
will be immediately verified. The maximizing terminology seems more convenient to study 
the connections with the thermodynamic formalism (see, for example, [51 117]). 
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separating sub-actions, that is sub-actions whose contact locus is the smaU- 
est one. As mentioned above, these sub-actions give more information on 
the minimizing measure(s) than does a general sub-action. Our main theo- 
rem (namely, theorem llOp states that such sub-actions are actually generic 
among the set of Holder sub-actions. An interesting result we also present 
here and which is independent of the previous considerations is an analysis 
related to the following situation: it is known that, for each irreducible com- 
ponent of the A-non-wandering set, one can associate via the Peierls barrier 
a calibrated sub-action. We present in theorem [T^] sufficient conditions (by 
no means necessary) that assure that there exists a dominant one among 
such calibrated sub-actions. 

Acknowledgement. We would like to thanks the referee for his careful 
reading of our manuscript. This improved the exposition of the final version 
considerably. 

2 A simplified version of theorems IIOL [TT] and [12 

Let {X, T) be a transitive expanding dynamical system, that is, a continuous 
covering several-to-one map T : AT ^ AT on a compact metric space X whose 
inverse branches are uniformly contracting by a factor < A < 1. We denote 
by Mt the set of T-invariant Borel probability measures. Our objective in 
this section is to summarize the conclusions of theorems [TOl [TT] and [12] in 
ergodic optimization theory. We first recall basic definitions from [9] (see 
also [16J). 

Given a continuous observable j4 : A ^ M, we call ergodic minimizing 
value the quantity 

A := min / A dfx. 

We call A-minimizing probability a measure fj, G Mj- which realizes the above 
minimum. 

We say that a continuous function n : A ^ M is a sub-action with respect 
to the observable A if the following inequality holds everywhere on A 

A>uoT-u + A. 

We would like to emphasize that, although the definition of a sub- action 
can be extended to other regularities (for instance, to the class of bounded 
measurable functions), we will only consider continuous sub-actions in this 
paper. 

Definition 1. A sub-action n : A ^ M is said calibrated if 
u{x) = min [u{y) -\- A{y) — A] for all x G A. 

T{y)=x 
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Definition 2. We call contact locus of a sub-action u the set 

Ma{u) := {A-uoT + uy^{A). 
It is just the subset of X where A = u oT — u + A. 

A point X (z X is said to be non-wandering with respect to A if, for every 
e > 0, there exists an integer k > 1 and a point y € X such that 

k-l 

d{x,y)<e, d{x,T\y))<e and | - ^) o T^(y)| < e. 

We denote by Q.{A) the set of non-wandering points with respect to the 
observable A G C^{X). When the observable is Holder, Q.[A) is a non- 
empty compact T-invariant set containing the support of all minimizing 
probability measures. Moreover, 

Vt{A) C 1^ |M^(ii) I n is a continuous sub-action|. 

We are interested in finding u so that Vt{A) = M^(n). 

Definition 3. A sub-action u € C^{X) is said to be separating (with respect 
to A) if it satisfies Ma{u) = Vt{A). 

The main conclusion of theorem [TU] can be stated in the following way. 
The proof of this particular case will not be given and can be adapted from 
the one of the general situation (see section [3D . 

Theorem 4. Let (X, T) be a transitive expanding dynamical system on a 
compact metric space and ^4 : X — > R 6e a 9-Hdlder observable. Then there 
exist a 9-Hdlder separating sub-action for A. Furthermore, in the 6-Hdlder 
topology, the subset of 9-Hdlder separating sub-actions is generic among all 
9-Hdlder sub-actions. 

We will present in theorem [6] a result of different nature and independent 
interest. The item which is totally new on this claim will be item 2. 

Contrary to a separating sub-action, a calibrated sub-action u possesses 
a large contact locus in the sense T(Mla{u)) = X. Calibrated sub-actions 
are built using a particular sub-action called the Peierls barrier. For Holder 
observable A, the Peierls barrier of A, h^ '■ i^{A) x X — > R, is a Holder 
calibrated sub-action in the second variable defined by 

k-i 

hA{x,y) := lim liminf inf < > {A — A) o T^{z) 



oo 



j=Q 



z e X, d{z,x) < e and d{T^{z),y) < e|. 
The equivalent theorem to [11] may be stated in the following form. 
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Theorem 5. Let {X, T) be a transitive expanding dynamical system on a 
compact metric space and A : X ^ M be a Holder observable. Then the set 
of continuous calibrated sub- actions coincides with the set of functions of the 
form 

u{y) = min [(^(x) + hAix,y)], \/ y e X, 

xef2(A) 

where (p : Q{A) — > R is any continuous function satisfying 
(p{y) - (p{x) < hA{x, y), V y G Q{A). 
Moreover, u extends (j) o^nd is thus uniquely characterized by (p. 

The condition x ~ y <^4- hA{x,y) + = defines an equivalent 

relation on 0,(A). An equivalence class is called an irreducible component. 
It is a closed T-invariant selH. 

In the case il.{A) is reduced to a finite number of disjoint irreducible 
components, the set of calibrated sub-actions is parametrized by a finite 
number of conditions. More precisely, if Q{A) = U[^^Cj is equal to a disjoint 
union of irreducible components and Xi G Cj are chosen, the sub-action 
constraint set is by definition 

eA(xi, . . . ,Xr) := {{Ui, . . . ,Ur) eW \ Uj - Ui < hA{Xi,Xj), V i,j}. 

Therefore, the analogous result to theorem [12] can be stated as follows. 

Theorem 6. Let (X, T) be a transitive expanding dynamical system on a 
compact metric space and A : X be a Holder observable. Assume that 
il.{A) = U[^]^Cj is equal to a disjoint union of irreducible components. 

1. There is a one-to-one correspondence between the sub-action constraint 
set and the set of calibrated sub-actions, 

(tti, . . . , Ur) E Qa{xi., . . . , Xr) ( u is a calibrated sub-action 

U{x) = ^^^^[Ut + hA{x^,x)] \ Ui = u{xi) 

2. Let io G {!,... ,r} and Ui^ G M fixed. Define Ui = Ui^ + hA{xiQ,Xi) 
for all i, then {ui, . . . , u^) G Qa{xi, . . . , Xr) and the unique calibrated 
sub-action u satisfying u{xi) = Ui, for all i, is of the form 

u{x) := min [uj + hAixi,x)] = Ui^^ + hA{xig,x). 

l<i<r 

^We prove these statements in the general setting (see definition-proposition [18] and 
proposition I19[) . 
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When the optimizing probabihty is unique, the cahbrated sub-action 
is unique (up to additive constants) and generally the proofs of important 
results are easiest to discuss. 

One of the main issues of the thermodynamic formalism at tempera- 
ture zero is the analysis, in the case there are several ergodic maximizing 
probabilities for A, which of these probabilities the Gibbs states fijSA accu- 
mulates, when the inverse temperature parameter f3 goes to infinite. It is 
not clear when there is a unique one in the general Holder cas^. In the case 
of a potential A that depends on finitely many coordinates, this question is 
addressed in [U [T7j . 

Let us denote, in our notation, hy Ci,C2, ■ ■ ■ ,Cr the different supports of 
the ergodic components of the set of maximizing probabilities for A. Then, 
one can ask: is there a unique one, let us say, with support in Cjg that will 
be attained as the only limit of Gibbs states when (3 — > oo? 

This question is in some way related to the result of item 2 of theorem [6j 
Indeed, the dual question can be made for the limits ^ log when /3 —>■ oo, 
where 0^ is the normalized eigenfunction for the Ruelle operator associated 
to the potential pA. It is well-known that any convergent subsequence will 
determine a calibrated sub-action, but is it not clear if there is only one 
possible limit. 

Hence, which one among the various calibrated sub-actions would be 
chosen? This is an important question. All functions of the form hAixi, ■), 
with Xi G Ci, are calibrated sub-actions, for any i = 1,2, ...,r. Item 2 
of theorem [6] gives sufficient conditions to say that a certain is 
preferred in some sense. We believe this fact is related to the important 
issues described above. 

3 Basic Concepts and Main Results 

For simplicity, we will restrict the exposition of the holonomic optimization 
model to the symbolic dynamics case. Let be a one-sided transitive 

subshift of finite type given by a s x s irreducible transition matrix M. More 
precisely 

S := |x G {1, . . . , s}^ I M{xj,Xj+i) = 1 for ah j > o| 

and a is the left shift acting on S by a{xo, xi, . . .) = (xi, X2, ■ ■ ■)■ Fix 
A G (0, 1). We choose a particular metric on S defined by d(x, x) = A'^, for 
any x, x G S, x = (xq, xi, . . .), x = (xq, xi, . . .) and k = mm{j : Xj ^ Xj}. 

The holonomic model is a generalization of the ergodic optimization 
framework. The holonomic model has been introduced first by R. Maiie in 

•^Examples of Lipschitz observables on the full shift {0, 1}*' for which the zero temper- 
ature limit of the associated Gibbs measures does not exist have been recently announced 
(see IS]). 
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an attempt to clarify Aubry-Mather theory for continuous time Lagrangian 
dynamics (see [8l|T9]). In this model, the set of invariant minimizing proba- 
bility measures is replaced by a broader class of measures called holonomic 
measures. In Aubry-Mather theory for discrete time Lagrangian dynamics 
on the n dimensional torus T" (see [14]). an holonomic probability measure 
fi{dx, dv) is a probability measure on T" x satisfying 

f f{x + v)d^i{x,v)= I f{x)d^^{x,v), V/gCO(T"), 

where the sum x + v is obviously taken modulo Z". 

One may exploit an interesting analogy with Aubry-Mather theory in 
symbolic dynamics. Similarly to the previous example of discrete dynamics, 
S will play the role of the "space of positions" (analogous to T" in the holo- 
nomic model) and the set of inverse branches or possible pasts S* will play 
the role of the "space of immediately anterior velocities" (analogous to M"). 
For a complete exposition and motivation of the holonomic optimization 
model, see [T2l[T3]. 

We call dual subshift of finite type the space 

S* := {y G {1, . . . ,sf ' | M{yj+i,yj) = 1 for all j > l}. 

We denote by y = (...,^3,^2,^1) a point of S*. We call dual shift the map 
(T*(. . . , ya, 2/2, yi) := (•••52/352/2)- The natural extension of (S,o") will play 
the role of the "phase space" (analogous to x R") and will be identified 
with a subset of S* x S 

S := |(y,x) = (. . . ,y2,yi\xo,xi, . . .) G S* x S | 

X = {xo,xi, . . .), y = (. . . ,y2,yi) and M(yi,xo) = l|. 

Equivalently, one may write S = Uxge ^ l^}' where 

:= {y = (• • • ) 2/2, yi) e S* | M(yi, ^o) = 1} V X = {xq, xi, . . .) G S. 

The analogue of the "discrete Euler-Lagrange map" is obtained by the 
usual left shift a on the natural extension, 

(t(. . ■ ,y2,yi\xo,xi, ...) = (.. . ,yi,xo\xi,X2, . . .)• 

Consider then r* : S — > S* given by 

'^*(y,x) := r*(y) := (. . . , 2/2, 2/1, 2;o). 

Notice that T*(y) G {a*)~^(y). Similarly, inverse branches of x G S with 
respect to a are constructed using the map r : S ^ S, 



T(y,x) := ry(x) = (yi,xo,X2, . . .)• 
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Clearly we have a{y,x.) := (T*(y), cr(x)) and a ^{y,x) = (cr*(y), ry(x)). 
Note that r = vr o a^^, where vr : S — > S is the canonical projection onto 
the X- variable. 

Let M be the set of probability measures over the Borel sigma-algebra 
of S. Instead of considering the set of a- invariant probability measureqj, we 
introduce the set of holonomic probability measures, 

Mhol := {a G M| ^/(ry(x)) df4y,x) = j^fi^) d^y,^), V / G ^"(S)}. 

It seems important to insist that the holonomic condition demands only the 
continuous function / to be defined on the one-sided shift of finite type S and 
not on the natural extension T, as would be the case for the characterization 
of (T-invariance. Observe that fi G Mhol if, and only if, 7r*(/i) = 7r*(cj~^(/i)) 
if, and only if, cr~^{/j,) projects onto a cr-invariant Borel probability measure. 
As in section [2l we denote by the set of cr-invariant Borel probability 
measures. The triple (S, a, Mhol) is called the holonomic model. Such a 
formalism includes the ergodic optimization model discussed in section [2] as 
we will see. 

Let A G C^(S) be a Holder observable. We would like to emphasize 
that A is continuous on the natural extension S. This is one of the crucial 
points in the holonomic setting: the possibility of formulating a relevant 
minimization question for functions defined on the two-sided shift. Then, 
we call holonomic minimizing value of A 

A := minj yl(y,x) d/i(y,x) I /i G Mhoij 

= minj ^ ° '5"(y,x)d/i(y,x) 1 7r*(/i) G M^j. 

liAoa = Bo7r depends only on the x- variable, ^ = i? as in the section [2j 
The set of minimizing (holonomic) probability measures is denoted 

Mhoi(^) := {a G Mhol I ^^(y,x) dfi{y,x) = Ay 

A continuous function u : S — > R is called sub-action with respect to A if 

u(x) - u(Ty (x)) < ^(y, x) - i, V (y, x) G S, 

or equivalently A — A > novr — novro a^^. We call contact locus of a 
sub-action u the set 

M^(u) := {A- uoir + uo7r oa^'^y'^{A) 

is well-known that a Holder observable defined on the two-sided shift is cohomol- 
ogous to an observable that depends just on future coordinates. So a minimization over 
o"-invariant probabilities may be reduced to a minimization over a"-invariant probabilities. 
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where the above inequaUty becomes an equahty, that is, a point (y, x) € S 
belongs to M.a{u) if, and only if, ti(x) — n(ry (x)) = ^(y, x) — ^. If yl o o" = 
B OTT for some S : S ^ R, notice that vr o (T"^(M^(ti)) = Mb(u). 

A calibrated sub-action is a particular sub-action which possesses a large 
contact locus in the sense that 7r(Myi(n)) = S. 

Definition 7. A sub-action n : S — > M is said to be calibrated for A if 
ti(x) = min [u(Ty(x)) -|-yl(y,x) — A\, Vx e S, 

where recall that S* := {y G S* | (y, x) € S}. 

B := A o a and i?(x) := min{i?(y, x) [ y E S* }, then n is a calibrated 
sub-action for A if, and only if, ti is a calibrated sub-action for B. Indeed, 

ii(x) = min min [''J-i^) + B{a*{y),x.) — A^ 

(t{x)=x yGEj,ry(x)=x 

= min [n(x) S(x) - ^] = min [n(x) B(x) - B] . 

(t(x)=x (t(x)=x 

(The definition of B gives B < A and the calibration gives B > j4.) 

A classification theorem for calibrated sub-actions is presented in |13j . 
A central concept is the set of non-wandering points with respect to A 
(previously defined in [SJ [T2] in the ergodic optimization model). We call 
path of length k a sequence (z*^, . . . , z'^) of points of S such that 

z^ = (y\x*) with x^ = ry»+i(x*+i), Vi = 0,l,...,A;-l, 

that is, a sequence {z^ , . . . ,z^) where x* = a^{'x.^) for all i = 0,1,..., fc, 
x° = {xo,xi, . . . ,Xfc_i,x''') and 

z° = (y°|xo, . . . ,Xfc_i,x''), z^ = {a*{y^),xo\xi, . . . ,Xfc_i,x^), . . . , 

z'^-i = (CT*(y'=~i),Xfe_2|xfc_i,x'=), z'^ = (fT*(y'=),Xfc_i|x'=). 

Note that the point y'^ is free of any restriction except that M{y^,xo) = 1, 
more precisely, one just asks that y° G E^o while y^' € S*, n ((t*)-1(S;,_i) 
for j = 1, . . . ,k. Equivalently, one could present a path in the following way 

z°= (y°,ryioTy2 0...oryfe(x'=)), z^ = (y\ry2 o...oryfc(x'=)), 

z^-^ = (y^-\ry.(x^)), z'= = (y^x'=). 

Given e > and x, x € S, we say that a path of length k, (z^, . . . , z^), 
begins within e of x and ends within e of x if (i(x'^,x) < e and d(x'^,x) < e. 
Denote by yfc(x, x, e) the set of such paths. Denote by J'fc(x) the set of paths 
of length k beginning exactly at x. Notice that a path (z*^, . . . , z^) belongs 
to J'fc(x) if, and only if, vr(z*) = (7*(x) for alH = 0, 1, . . . , A;. 
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A point X G S will be called non-wandering with respect to A if, for every 
e > 0, one can find a path (z^, . . . ,z^) in J'fc(x, x, e), with k > 1, such that 



i=l 



< e. 



We will denote by Q{A) the set of non- wandering points with respect to A. 
If Ao a = B o IT, notice that i}(A) = ^}{B) as in section [2j 

The first two authors have proved in [13j that Q(A) is a non-empty 
compact fj-invariant set and satisfies 

i}{A) C |7r(M^(u)) I It is a continuous sub-action|. 

Remark 8. The set i}{A) is analogous to the projected Aubry set in the 
continuous time Lagrangian dynamics. One could have introduced the cor- 
responding Aubry set ^}{A) C S and proved 7r{0,{A)) = ^}{A). Unfortu- 
nately, even for Holder observable A, the graph property is not any more 
true: vr : i}{A) ^}(A) is no more bijective. A counter-example can be found 
in It would be interesting to find the right assumptions on A ^ C^($]) 

in order to get this property. 

Contrary to a calibrated sub-action, a separating sub-action is a sub- 
action with the smallest contact locus. More precisely, 

Definition 9. A sub-action u € C*'(S) is said to be separating (with respect 
to A) if it verifies 7r(M^(u)) = 9.[A). 

Our first result is the following one. 

Theorem 10. If A : ^ is a 9-Hdlder observable, then there exists 
a 9-Hdlder separating sub-action. Moreover, in the 6-Hdlder topology, the 
subset of 9-Hdlder separating sub-actions is generic among all 6-Hdlder sub- 
actions. 

According to the analogy with continuous time Lagrangian dynamics, 
sub-actions correspond to viscosity sub-solutions of the stationary Hamilton- 
Jacobi equation, calibrated sub-actions correspond to the weak KAM solu- 
tions introduced by A. Fathi (see [10]) and separating sub-actions correspond 
to special sub-solutions as described in [TT] . 

By adapting the proof of theorem 10 in [13] and by using definition [H] 
of the the Peierls barrier hA_, we obtain a structure theorem for calibrated 
sub-actions. Such characterization corresponds to the one obtained for weak 
KAM solutions in Lagrangian dynamics (see ^ ) . The proof of the following 
theorem will be omitted. 



Theorem 11. Let A be a 9-Hdlder observable. 
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1. If u is a continuous calibrated sub-action for A, then 

ti(x) = min Ttifx) + /i/i{x, x)l . 
xen(A) 

2. Conversely, for every continuous application (f) : Q{A) — > M satisfying 

(^(x) - (j){5i) < /ia(x, x), V X, X G ^{A), 

the function u{x) := minxgQ(^) [(/)(x) + /i^(x,x)] is a continuous cali- 
brated sub-action extending (j) on il{A). 

In particular, this representation formula for calibrated sub-actions im- 
plies immediately that, in order to compare two such functions, we just need 
to compare their restrictions to n{A). For instance, if two calibrated sub- 
actions coincide for every non-wandering point with respect to A, then they 
are the same. 

In the case the set of non-wandering points for A is reduced to a finite 
union of irreducible components ^(^4) = Ci U . . . U C,-, the set of calibrated 
sub-actions admits a simpler characterization. Wc first show that the con- 
dition X ~ X <^ /i^ (x, x) + Ha (x, x) = defines an equivalent relation. 
Each one of its equivalent classes is called an irreducible component. Let 
x^ G Ci, . . . ,x'' G Cr fixed. We call sub-action constraint set the set 

e^(x\ . . . ,x'') = {{ui, ...,Ur)(^ M'' I Uj -Ui< hA{x\5c'), V i,j}. 

Our second result is the following one. 

Theorem 12. Let A be a Holder observable. Assume Q{A) is a finite 
union of disjoint irreducible components, namely, il{A) = U^^^^Cj. Let 
x^ G Ci , . . . , x'" G fixed. 

1. If u is a continuous calibrated sub-action and Ui := u{x^) for every 
i = 1, . . . ,r, then 

{ui, . . . ,Ur) E Q{yi^, . . . ,yi^) and 'u(x) = min [^(x') -|- /i^(x', x)l . 

l<i<r 

2. // (ui, . . . , Ur) G C(x-'^, . . . , x'') and 'u(x) := mini<j<r [uj -|- x)] , 
then u is a continuous calibrated sub-action satisfying u{5c^) = Ui for 
all i = 1, . . . ,r. 

3. Take i^ ^ {1, . . . ,r} and (ui, . . . , Uj.) such that Ui := Uj,, + /iyi(x*'', x*) 
for all i = 1, . . . ,r. Then is unique, {ui, . . . ,Ur) G C(x^, . . . ,x'') 
and the unique calibrated sub-action u satisfying u{x^) = Ui, for all 
i = 1, . . . ,r, is of the form ■u(x) = Ui^ + /i^i (x*o , x) . 



12 



E. Garibaldi, A. O. Lopes and Ph. Thieullen 



The application we present here has a certain similarity to lemma 6 in [T] . 
We point out that the local character of viscosity solutions (as in definition 
1 of [1]) is not present in our setting. 

Application 13. Let A be a Holder observable. Consider any continuous 
sub-action v and a continuous calibrated sub-action u. 

1. Then u — v is constant on every irreducible component and 

min(u — v) = minfn — v). 

s n{A) 

2. Assume Q{A) = U^^j^Cj is a finite union of disjoint irreducible compo- 
nents. //min2(n — v) is realized on an unique component Ci^ and the 
other components Ci, i ^ ii, are not local minimum for u — v, then 

u(x) = n(xjj + /iA(xi-^,x), V X € S, 

where Xj^ is any point in Ci^ . 

4 Proof of theorem [TO 

We first recall two notions of action potential between two points: the Mane 
potential and the Peierls barrier. Given e > 0, x, x € S and /c > 1, we 
denote 

k 

5i(x, X, k) = inf { Y,iA - I . . . , z'^) e n(x, X, e)}. 

i=l 

If B := A o a and B := min{i?(y, x) | y € S* }, notice that 

fc-i 

S^(x,x,A;) =inf{ J^(5-^)o(7^(x°)|d(x°,x) < e, d(a'=(x°), x) < e}. 
i=0 

Definition 14. We call Marie potential the function 0^ : S x S ^ MU{+cxd} 
defined by 

(/)yi(x,x) = lim inf S'^(x, x,A;). 

e-^O k>l 

We call Peierls barrier the function /i^ : S x S ^ M U {+cx3} defined by 
hji(x,5c) = lim lim inf 5'^(x,x,A;). 

e— >0 fc— >+oo 

Clearly, (pA ^ h-A and both functions are lower semi-continuous. We 
summarize the main properties of these action potentials. 

Proposition 15. Let A be a Holder observable. 
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1. If u is a continuous sub-action, then u{5c) — u{x) < (/>yi(x, ic). 

2. For any points x, x, x G S, </>a(x, x) < (pAi^, x) + 0a (x, x). 

3. Given a point x £ 12, if there exists a positive integer L such that 
< L < min{j > : c-^(x) = x} < +00, then 

(/>a(x, x) = (/>a(x, cj^(x)) + (/)a((T'^(x), x). 

Moreover, if (j)A(x,x.) < +00, then there exists a path of length L, 
(zP = {y^,x.^), . . . = (y^,x^)), beginning at x (x-^ = o"-^(x) for all 
j = 0, . . . , L), such that 

L 

<^A(x,a^(x))=^(^-i)(z^-). 

J=l 

4. For any points x, x,x G E and any sequence {x^} converging to x, 

Ha (x, x) < lim inf (/)a (x, x' ) + hA (x, x) . 

1^+00 

5. Ifxe S, then x e n{A) <^ (/)a(x, x) = 44> /ia(x,x) = 0. 

6. Ifx € ^{A), then (/)a(x, •) = /ia(x, •) and /ia(x, •) is a Holder calibrated 
sub-action with respect to the second variable. 

This proposition shows how to construct Holder cahbrated sub-actions 
without the use of the Lax-Oleinik fixed point method. 

Remark 16. In Lagrangian Aubry-Mather theory on a compact manifold 
M, it is well known that, for any point x G M , the map y £ M ^ h{x, y) G M 
defines a weak KAM solution, where h : AIxM ^ denotes the correspond- 
ing Peierls barrier. The analogous result for hA{x, •) is however false in the 
holonomic optimization model. Using item 3, it is not difficulty to built 
examples where 

hm (/)a(x, cj^(x)) = hm /ia(x, cj^(x)) = +00, 

L— >+oo 

which shows that /ia(x, •) is not always a continuous function. 

Proof of proposition [75l Items 1, 2, 5 and 6 are well known and a demon- 
stration can be found, for instance, in O [13]. So let us prove items 3 and 
4. 

Item 3. We already know from item 2, that 



(/)a(x,x) < (/.a(x,cj^(x)) +</)A(a^(x),x). 
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Define r] = min{d(cr*(x), cr-' (x)) : < i < j < L}. Fix 7 > and take 
e G (0,min{A, 7?/2}) sucii tliat H61d(y4)Le^ < 7. Consider also p G (0, e) 
sucli that d{x,5c) < p implies (i(c7-' (x), a-' (x)) < e for 1 < j < L. Take then 
a path (z°, . . . , z') G J'i(x, x, p) satisfying 

/ 

y{A-A){z^) < inf 5^(x,x,A;)+7<.^a(x,x)+7. 

k>l 

Let = (y-' , x-') where x-' = a^{-x.^) for all j = 0,1, ... ,1. Wc claim that 
I > L. Indeed, p has been chosen so that, for each j G {1, 2, . . . , L}, 

d(x^x) = d((7^(x°),x) > c/((7^(x),x) - CZ((7^(X),(T^(X°)) > 7/ - e > p. 

Introduce a new path (z°, . . . , z^) G CPl(x, x, e) given by = (y^, cr-'(x)), 
for all j = 0, . . . , L. The definition of p guarantees 

L L L 

Y^{A- A){z^) <Y^{A- A){z^) + Holds (A)Le^ < " + 7- 

Notice that (z-^, . . . , z') G y/_L(cr^(x), x, e). We finally obtain 
inf 5^(x, a^(x), A;) + inf 5^(a^(x), x, fc) 

K>1 K>1 

<j2{A-A){z^)+ {A-A){z=) 

j=l j=L+l 
L I 

<Y^(A-A){z^)+ (A-A)(z^)+7 

J=l j=L+l 

< inf 5^(x, X, fc) + 27 < (^^(x, x) + 27. 
fc>i 

By letting e goes to and 7 to 0, we get 

.^A(x,a-^(x)) + </)a((t-^(x),x) < (^a(x,x). 

The first part of item 3 is proved. To prove the second part, the previous 
computation shows that, for any sufficiently small e, there exists a path 
(z^, . . . ,zf') G ?l(x) such that 

L 

- A){zi) + inf 51(a^(x),x,fc) < </)^(x,x) + 27. 

By taking accumulation points of when e — > 0, we obtain, for any 7, a 
path {tP,... , z^) such that 

L 

.^a(x,(7-^(x)) < YiA-A){z^) < ,^a(x,x) -,^a(<t^(x),x) +27 

i=i 
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The result follows from item 2 and by taking once more accumulation points 
of 2? when 7—^0. 

Ite.m 4- Since (pA is lower semi-continuous, the statement is equivalent to 

/ia(x, x) < 0a(x, x) + /iA(x, x), V X, X, X G S. 

Fix 7 > and e G (0, A/2) such that H61d(^)(2e)^/(1 - A^) < 7. There 
exists a path (z°, . . . , z^) G Tfc(x, x, e) such that 

k 

5^(A-l)(z^)< infS^(x,x,n)+7. 

^ — ' n>l 

i=i 

For any A'^ > 1, there exists a path (z*^, . . . , z') G J'i(x, x, e) of length I > N 
such that 

I 

Y,{A - A){z^) < mf^5i(x,5,n) +7. 

We define a path {zP,. . . , z*+') G ^^^^(x, x, 3e) in the following way 

P = 2.^-'', V j = k + l,...,k + l, W = (y^F), V j = 0,...,k, 
fj = V i = 0, . . . , k, x*^ = xO, 5^-1 = ry,(x^), V j = 1, . . . , fc. 

We notice that d(x-' , X'' ) < X^~^d{k^, x*^), for all j = 0, . . . , k. Since 

d(^^x*^) = d(xO,x*^) < d(xO,x) + d(x,x*^) < 2e, 

we obtain (i(x°,x) < A*^2e + e < 3e. Hence, it follows that 

k+l 

mf^5f(x,^,n)<^(^-l)(^^) 

7 7.. 

(26) 



< Y.{A - A)(z^) + ^(A - A)(z^) + A_Z_Hold,(^) 

i=i i=i 

< inf 5^(x, X, n) + inf ^^(x, x, n) + 87 

n>l n>Af 

< (t>A{y^, x) + inf ^^(x, X, n) + 87. 

n>N 

By taking first — > +cxd, then e ^ and 7 — > 0, we get 
/ia(x,x) < <;iiA(x,x) + /ia(x,x). 



□ 
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Other properties of the Mane potential and the Peierls barrier can be 
derived from the previous proposition. For instance, item 4 gives us the 
following inequality 

x) < /ia(x, x) + /ia(x, x), V X, X, X G S. 

We now begin the proof of theorem [TOj It follows immediately from the 
next lemma. 

Lemma 17. Let D C T, be an open set containing ^}{A). Denote by 
the subset of Holder sub-actions u such that 7r(MA(ti)) C D. Then, for the 
Holder topology, Da is an open dense subset of the Holder sub-actions. 

We only need a few lines to show that lemma [T71 vields theorem llOi As 
a matter of fact, if one considers, for each positive integer j, the open set 

= {x € S I d{x,Q{A)) < l/j} and the corresponding open dense subset 
of Holder sub-actions T>A_,j, then the set of Holder separating sub-actions 
contains the countable intersection Djyo'Djij. 



Proof of lemma 17. We only discuss the denseness of T>a- 

Part 1. Let v be any Holder sub-action for A. We will show that, for every 
X ^ D, there exists a Holder sub-action fx as close as we want to v in 
the Holder topology with a projected contact locus disjoint from x, that is, 
X ^ 7r(MA(i^x)) or 

t^x(x) - t;x(ry(x)) < A(y,x) -A, V y G S* . 

Let X ^ D. We discuss two cases. 

Case a. We assume there exists an integer A; > such that, for every path 
of length k beginning at x, (z" = (y^, x), . . . , = (y'^, cr^(x))) G yfc(x), the 
terminal point z,^ Ma(w). If A; = 0, we choose fx = v. Assume now k>\. 
Let 

B ■.= A — A — VOTT-l-VOITO (T~^ > 

be the associated normalized observable (-B > and S = 0). We recall that 
ryj(cr-'(x)) = o"-^~-^(x), for all j = 1, . . . , k. So by hypothesis 

B{zl^) = B{y\aH^)) > 0, V y^ G S^.^^^ s.t. ^'^-^(x) = v.(a'=(x)). (I) 

Notice first that, if (z*^, . . . , z^) is a path of length k and 7 G (0, 1) is any 
constant, as B is non-negative, one has 

k-l k 

B{z^) = Y,B{z^)-Y.B{z^) + B{z^) 
j=o 3=1 

fe-l k fc-1 k 

> 7 ^ S(z^) - 7 X] ^(^^) + l^iz!") > 7 B{z^) - 7 5Z 
j=o j=i j=o 3=1 

(11) 
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Let iffc : S ^ M be the function given by 

k 

Wk{5t) := inf { ^ B{z^) \ (2°, . . . , z*^) G n(x)}, V x G S. 

i=i 

Because J'a,.(x) is a closed subspace of the compact space S^"*"^, the above 
infimum is effectively a minimum. Moreover, since the application Cfx) := 
min{i? o a{y, x) | y G S|} is Holder, Wk = Yl'j=o ^ ° '^^ HoldeiO. 

We first prove that —^w^ is a sub-action. Let x G S and y G S|. 
There exists a path of length k, {zP, . . . ,z^), beginning at x and realizing 
the minimum 

k 

i=i 

Notice the only constraint on y'' is y'^ G Ei, besides y" does not appear 
in the previous sum. Choose y° = y, y~^ G and call x~^ = ry(x). 

Then {z~^,zP, . . . , z^~^) is a path of length k beginning at Ty(x). So denote 
z := (x, y). Thanks to inequality (II) 

k-l k 

B{z) = i?(zO) > 7 J^i?(z^) -7^i?(z^) > 7u;,.(Ty(x)) -7u;fc(x), 
i=o j=i 

which shows —'jWk is a sub-action for B. Moreover, given any y G S* , the 
same computation for z := (x, y) instead of z and (I) assure that 

B{z) - 7u;fc(Ty(x)) + 7ii'fc(x) > 7^(z*'') > 0. 

We have proved that x ^ 7r{MB{—jWk)) = 7r(MA(f — ^Wk))- 

Since 7 can be taken as small as we want, we have shown the existence of 
a Holder sub-action = v — ^Wk close to v in the Holder topology satisfying 
X ^ tt{Ma{v^)). 

Case b. We suppose that, for every integer A: > 0, one can find a path of 
length k, (z^, . . . , z^), beginning at x, such that z^ G M.a{v), or equivalently 
B{z'^) = with B as before. In other words, there exists y*^ G S* with 
i?(y°,x) = and, for any A; > 1, there exists y'^ G r\{a*)^^{T.*^f._i) such 
that B{y^,x.^) = 0, where x'^ = (T*^(x). Define z° = (y°, x) and z^ = (y'^, x*^) 
for all A; > 1. Notice that (z'', . . . ,z^) is now a path of arbitrary length k, 
beginning at x, which satisfies B{z^) = for j = 0, . . . ,k. 

Let X G Q,{A) = Q{B) be any limit point of (x'^)^ chosen once for all. 
Let w := /iB(x, •) be the Holder sub-action for B given by the corresponding 
Peierls barrier. Notice that by the definition of the Peierls barrier (see 

^We leave the details to the reader. In particular, one shall note that Wk = o a-' 

means min(o + 6) = mino + minfe, which indicates the importance of what a path is. 
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definition I14p we clearly get /i_b > 0, since B >0 and B = 0. Furthermore, 
we remark that ipsi^, ^'^i'^)) — foi' all A; > 1 and that 

w{x) = /ib(x, x) = liminf (psi^, o'^i^)) + hB{x,x) > /i_b(x, x) > 0. 

A;— >+oo 

Here we have used item 4 of proposition [TS] to obtain the first inequality 
and item 5 of the same proposition to assure the strict inequality since 

X ^ L» D n{A) = n{B). 

Let 7 G (0, 1) be any real number as close to as we want. We claim 
that X satisfies again the first case, namely, there exists k > 1 such that, for 
any path of length k, {tP = (y*^, x^), . . . = (y*^, x*^)), beginning at x, one 
has 

B(z'=) -7/ib(x,x'=) + 7/ib(x,x'=-1) > 0. 

(Notice that 'yw is again a sub-action for B since B is non- negative.) Indeed, 
by contradiction, for any integer A; > 0, we would have a path of length k, 
{tP = (y'^jx"), . . . ,7,^ = {y^ beginning at x, such that z.^ G Wisi'^w), 
which would yield 

< Biz^) =7/ib(x,x'=) -7/ib(x,x'=~1), VA; > 1. 

On the one hand, from the inequality 7/ib(x, x'^^"'^) < 7/ib(x,x*'), we would 
obtain < w;(x) = /ib(x,x) < /ib(x, x'^) for all k>l. On the other hand, 
by taking a subsequence of {x'^} = {cr'^(x)} converging to x, /^^(x, x'^) 
would converge to /ib(x,x) = 0, since x G Q{B). We have thus obtained 
a contradiction. Hence, case (a) implies that there exists a sub-action t^x, 
close to V in the Holder topology, satisfying x ^ it(M.a{v:x.))- 

Part 2. We have just proved that, for any x ^ D, there exists a sub-action 
t>x close to V and a ball -B(x, ex) of radius ex > centered at x such that 

VxGS(x,ex), x^^(MaK)). 

We can extract from the family of these balls {i?(x, ex)}x a finite family 
indexed by {^•'}i<j<K which is still a covering of the compact set Ti\ D. 
Let 



1 



K 



i=i 

Then it is easy to check that n is a Holder sub-action for A satisfying 
7r(M^(n)) C D, namely, u G Da- Since each sub-action Wx can be taken as 
close as we want to v in the Holder topology, the same is true for u. □ 



5 Proof of theorem [12 

It was proved in [TH] that the projection of the support of a minimizing 
probability measure ft is included into the ^-non- wandering set i}(A) when 
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such projection is ergodic. If vr^/i is ergodic, 7r(supp(/i)) may be seen as an 
irreducible component in the sense that any two points can be joined by an 
e-closed trajectory. We introduce here a more general notion of irreducibility. 

Definition-Proposition 18. Let A : T, ^ M be a Holder observable. We 
say that two points x,x of Q{A) are equivalent and write x ~ x z/ 

/ia(x,x) + /ia(x,x) = 0. 

Then ~ is an equivalent relation. Its equivalent classes are called irreducible 
components. 

Proof. It is obvious that ~ is reflexive x) = 44> x G ^(A)) and 

symmetric. Let u be a continuous sub-action and B := A — A — uott + uot 
be the associated normalized observable. Then the definition of the Peierls 
barrier (see definition I14p implies 

/ib(x, x) = x) — ii(x) + n(x), V X, X G E. 

Since /ib(x, x) > 0, we see that x ~ x -<4> /ib(x, x) = and /ib(x, x) = 0. 
To show the transitivity property, it is enough to prove 

X X and x ~ x =^ /is(x, x) = 0. 

But proposition [15] guarantees 

< /i_b(x, x) < /ib(x, x) + /ib(x, x) = 0. 

The transitivity property is proved. □ 

Proposition 19. The irreducible components are closed and a-invariant. 

Proof. Part 1. Let x G Q{A). Consider {x^le a sequence of points of 
^}{A) equivalent to x and within e of x G ^}{A). Then on the one hand, 
/ia(x, x) + /iyi(x,x) > /ia(x, x) = 0, and on the other hand, 

/lA(x,Xe) + /ia(x,x) < /lA(x,Xe) + /lA(x,Xe) + /lyl(Xe,x) = /ia(x,X,). 

By continuity of /iyi(x, •) and /ia(x, •) with respect to the second variable, 
the previous inequality gives /ia(x,x) + /ia(x,x) < 0. Therefore x ~ x and 
the class containing x is closed. 

Part 2. Let x G Either (t(x) = x and in an obvious way cj(x) ~ x or 

(t(x) 7^ X and item 3 of proposition [TCI shows 0yi(x, (j(x)) + (?!)A(cr(x), x) = 
(/>a(x, x) = 0. Remember that /iA(y, •) = 4>a{y-,-) whenever y G ^{A)] 
note that x and (^(x) belong to the cr-invariant set n{A). Then we get 
/iA(x, cr(x)) + /ia(o"(x),x) = /ia(x, x) = and x and (t(x) belong to the 
same irreducible class. □ 
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We assume from now on that Q{A) is equal to a disjoint union of irre- 
ducible components, i}{A) = Ci U . . . U Cr- The following proposition shows 
that the Peierls barrier normalized by a separating sub-action could play 
the role of a quantized set of levels of energy. 

Proposition 20. Let A be a Holder observable and assume that Q{A) = 
[A\^iCi is equal to a finite union of irreducible components. 

1. If u is a continuous sub-action, then 

(x^jX-') 1-^ /ia(x*,x-') — n(x'') -|- u(x*) is constant on Ci x Cj. 

2. If u is a continuous separating sub-action, then 



Proof. We first normalize A by taking B = A — A — uott-\-uot so that 



B > and S = 0. 

Part 1. Let (x*, x^), (x\ x-') G Q x Cj. Then /ib(x*,x*) = /ib(x^x^) = 



Conversely /ib(x*,X'') < /ib(x*,x-') and we have proved that /i_b(-, •) is con- 
stant on Ci X Cj. 

Part 2. Let {U^}r]>o be a basis of neighborhoods of Cj. Since cj(Cj) C Q 
is disjoint from each Cj, j ^ i, there exists rj > small enough such that 
<j{U^) is disjoint from Uj^iUj. Let i / j and x G Cj, x G Cj. For e > 
sufficiently small, the ball of radius e centered at x is included in . Let 
(z^ = (y", x^), . . . , = (y'^, x^)) be a path of length k within e of x and x, 
more precisely, satisfying (i(x*^,x) < e and (i(x^,x) < e. Let p > 1 be the 



first time aP{x) ^ . Then aP~^{x) G and aP{x) e a{U^) \ U^ . By 
the choice of r/, ctP(x) ^ U^'^it// =: U D Since ^^(A) = 7r(M^(u)), let 

U := 7r-i(U), then z? U and 



/ia(x*,x- 



> u(x^) - u(x*), V (x\x^) G Q X Cj, V i / j. 



and 



/ib(x\x^) </ib(x\x^ 



) + /^iJ(x^x■ 



:^)+/^iJ(x^x^) < /ib(x\x^). 



A: 




5(z') > 5(zP) > minS =: m > 0. 



1=1 



We have proved that /i5(x, x) > m > 0. 



□ 



We are now in a position to prove our second result. 



Proof of theorem\12X We fixed once for all ^ Ci. 
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Part 1. We know from theorem 1111 that a continuous cahbrated sub- action 
satisfies u(x) = minxgQ(^) [u(x) + /i^(x, x)]. If x G Cj, then x ~ x* and 
/ia(x\x) + /iA(x,xO = 0. Then 

ti(x*) + /ia(x\x) < n(x*) + /ia(x\x) + /ia(x,x) 

= n(x*) - /ia(x, X*) + /ia(x,x) < n(x) + /iyi(x,x). 

We have proved that n(x) = mini<j<,.[n(x*) + /ia(x*,x)]. The fact that 
(w(x'^), . . . ,u{yi^)) G Ca(x"'^, . . . ,x'") comes from items 1 and 6 of proposi- 
tion El 

Part 2. Let {ui, . . . ,Ur) € eA(x\ • • • , x"") and define : n{A) ^ R by 
4>{x) := Ui + /ia(x*, x) for all x G Cj. We notice that (j) is continuous and we 
show that (/>(x) — 0(x) < /ia(x, x) for all x,x G Q(A). Indeed, if x G Cj and 
X G Cj, then 

(j){5t) - 0(x) = {uj - Ui) + hA{^^,i} - /ia(x\x) 

< /ia(x\x-'') +/ia(x-'',x) -/ia(x*,x) 
= /ia(x\x-'') - /iA(x,x-'') - /ia(x*,x) 

< /ia(x',x) - /ia(x*,x) < /ia(x,x). 

(The last but one inequality uses item 1 of proposition [15] and the fact 
that /ia(x*, ■) is a sub-action.) By theorem II H we know that the function 
n(x) := minxgQ(^) [(/)(x) -|- /ia(x, x)] is a continuous calibrated sub-action 
which extends (p on ^}{A). In particular, n(x*) = (/>(x*) = and, thanks to 
part 1, u coincides with mini<j<j.[uj -|- /ia(x*, •)]. 

Part 3. Let G {1, • • • ,r}. If (ui, . . . ,Ur) satisfies n, = Uig + /ia(x*°,x*), 
then io is unique. Otherwise there would exist ii ^ io such that Ui = 
Ui^ -h/iA(x*i,x*). Thus 

■Uji = + hA (x*" , x*^ ) and Ui^ = Ui^ + /ia (x*^ , x*° ) . 

We would obtain /ia(x*",x*0 + /ia(x*\x*o) = contradicting x*" ^ x*i. 
The fact that (ui, . . . , u^) G Ca(x-^, . . . , x*") comes from 

Uj -u, = /^A(x*^x^■) - /iA(x*°,x*) < /iA(x\x-'). 

The end of part 3 follows since ii(x) := Ui^ + /ia(x''',x) already defines a 
calibrated sub-action satisfying ti(x*) = n, for all i. □ 

The proof of application [13] is elementary. 

Proof of application \13[ Define B := A — vott + vot — A, then the null 
function is a sub-action of B and u — n is a sub-action calibrated to B. 
Moreover, /ib(x,x) = /ia(x,x) — f(x) -|- f(x) and ^(A) = Q(B). It is 
therefore enough to assume A normalized {A >0 and ^4 = 0) and v = 0. 
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Part 1. If X ~ X are two points of 0,(A), then /iyi(x,x) = and /ia(x,x) = 0. 
Thanks to items 1 and 6 of proposition 115^ we obtain u(x) = n(x). If x is 
any point of S, by the caUbration of u, one can construct an inverse path 
{z-'}i>o of E, with 7r(z0) = x, such that u{y.-') - u(x-^-i) = A{z-'), 
x~' = 7r(z~*), for all i. Let x be an accumulation point of {x^*}j>o. Then 
X G ^1{A) and, since ^ > 0, the sequence {ii(x~*)}j>o is decreasing. In 
particular, n(x) > n(x) establishes min^ u = min^^y^-) u. 

Part 2. Let Ui be the value of u on Cj. Assume we have ordered these 
values as Ui^ < Ui^ < . . . < Ui^. Let x* G Cj fixed. It suffices to prove 
m(x*'=) = n(x*i) + /ia(x*Sx**=) for all = 1, . . . , r. It is true for k = 1. Since 
Cii^^-^ is not a minimum local of u, one can find a sequence of points {x^}eyo 
within e of Ci^.^^ such that n(xe) < ii(x*''+i). From part 1 of theorem 1121 
there exists an index j such that u{x^) = u{5t^) + /iyi(x-^, x^). Since Ha > 0, 
Uj = u{5L^) < n(xe) < Ujj.^-^. So j has to be one of indexes h,. ■ ■ ,ik- By 
induction, u{x.^) = u(x*i) + /lyi (x*^ , x-' ) and 

u(x,) = u(x*i) + /ia(x^\x^) + /ia(x^x,). 

On the one hand, /iyi(x*i , x-') + /iyi(xJ', x^) > /iA(x*i,Xe) implies 

ti(xe) > ti(x*i) +/ia(x*\x,). 

On the other hand, as u is a sub-action, we obtain the reverse inequality 
and finally 

W(X,) = W(X^I) +/lA(x^l,Xe). 

Letting e go to 0, x^ accumulates to Cij._,_i and 

u(x^'=+i) = 'u(x*i) +/ia(x^i,x**+i). 

□ 
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